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ABSTRACT 

The results of the May 1984 British Columbia Reading 
Assessment were presented in this summary report. Highlights of the 
survey, summary tables of important results, and conclusions and 
recommendations made by the Contract Team were outlined. The students 
in grades four, seven, and ten completed achievement surveys and 
attitude scales. Five domains were identified by an advisory 
committee of classroom teachers and subject specialists. Items were 
developed to assess students' competence in each area. The domains 
assessed were Words and Expressions; Literal Comprehension; 
Inferential Comprehension; Critical Comprehension; and Locates/Uses 
Information. The next assessment of reading is scheduled to take 
place in 1988. (DWH) 
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READING RESULTS ANNOUNCED 



In May, 1984, over 98,000 British Columbia students completed achievement surveys and 
attitude scales in the third British Columbia Reading Assessment* At each of grades 4, 7 
and 10, the areas of reading examined were: Word and Expressions; Literal, Inferential and 
Critical Comprehension; and Locates and Uses Information* 

Panels of teachers, parents and trustees rated student achievement as Very Satisfactory in 
ten of the fourteen domains and as Satisfactory in the four other domains* 

The Very Satisfactory rating indicates that student achievement surpassed expectations for 
a "good" education system and approached the level judged H desirable N * 

Dr. Sharon Jeroski, Chairman of the Contract Team says, "Clearly, the current student 
population is meeting the widely held expectations for reading performance" • 



HIGHLIGHTS 



Students displayed relatively positive attitudes toward reading. They reported high 
levels of enjoyment fr>r reading fiction and assigned high values to reading as a means 
of acquiring inf oration and enhancing school achievement. 

Students at all grades displayed high levels of literal comprehension and skill in 
organizing factual material on open-ended questions. 

Most students could make appropriate inf erences/ judgements about the material they 
read. 

Boys reported reading and enjoying a greater variety of reading materials. 

Student achievement and attitudes differed according to home environment and amount of 
leisure reading. 



Gender 4 Iff erences favored girls in both achievement and attitude. The difference for 
achievement was greatest at Grade 7; for attitude at Grade 10. 
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Tht main prlnclplt underlying province-wide assessments is that tht decisions About education ihould be based on 
up-to-date information on what And how students Are learning* 
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WHO CONDUCTED THE AJSISSHWTt 



The Contract Team vaa headed by Dr# Sharon Jeroakl from 
Hoi iron Research and Associates* The Contract Team was 
guided by an Advisory Committee of teachers, admini- 
strators, a school trustee, and Ministry represent- 
atives. The Educational Research Institute of British 
Columbia was responsible for the production, distri- 
bution and scoring of all forms and the analysis of the 
results* 

Fall review panels of reading teachers assessed the 
appropriateness of the the questions for the final 
forms. Interpretation panels met in June, 1984 to 
interpret the provincial results* Namer of all 
participants can be found in the Summary Rev 
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WHAT SKILLS WERE TESTED? 



One of the first steps in assessment is to decide what will be tested. An Advisory Committee of classroom teachers 
and subject specialists carefully studies the objectives of the current curricula, and decides which should be 
tested. In this assessment, five domains were identified and items were developed to assess students' competence* 



Domain descriptions and samples of questions used are 
found through the Update. Space does not permit the 
printing of stimulus passages. 



Domain 2; Literal Comprehension (sample) 

This domain required students to indicate under- 
standing of main ideas, of sequence, of 
relationships, and of supporting information 
when explicitly stated in text. 



After reading a letter to parents which announces 
plans for a track meet, Grade 4 students were 

asked: 

What should students do «ith the form after it 
has been signed by a parent or guardian? 



Bring it to the Track Meet. 

Bring it to the school by Wednesday, 

May 26. 

Return it in a sealed envelope by 
May 28. 

Give It to the Home-School president. 
I don't krtow. 



* right answer 



X 




3 


A. 


64 


*B. 


26 


C » 


3 


D. 


2 


R. 



B.C. IKADXBO ASSESSMENT 1984 



The 1984 Resdlng Assessment differed in several ways 
from previous assessments* Those differences Included: 

1. Grades tested were 4, 7 and 10; in previous assess- 
ments grades 4 , 8 snd 12 were used • This has 
limited comparisons to previous assessments. 

2. School level reports listing domain scores at 
school, district and provincial levels have been 
provided to school districts. 

3. The emphasis has been on testing comprehension as 
the ultimate goal of reading instruction rather 
than looking at enabling skills such as phonics or 
compound words. 

4. Q forms, administered to 4% of the students, 
required students to write answers. Multiple- 
choice questions are the single most effective 
means of obtaining information in large-scale 
assessments* However, when it is desirable to 
discover student ability to respond, to sustan- 
tlate, to orgsnlze or to Integrate information, the 
open-ended format is preferable. Details of the 
findings from Q forms will be found in Chapter 5 of 
the Summary Report . 
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In order to.mfke Judgeasnta About atudent performance, the inter pre tetion penellets (30 et eech grede level) 
carefully examined each item for difficulty end then decided on "acceptable- end "desirable" leveli of achievement. 
Individual! then net in well groupe end leter ee e grede panel to reach coneeneue on whet levele of achievement 
etudente in thet grede ehould attain. 



*MPC - the Mean Percent Correct ie the 
everege percent of etudenti who choee 
the correct reeponee for ltema in a 
pertlculer objective or domain. 



**PR - Panel Rating a have the following 
meeninge: 

5 - Strong 

4 - Very Satlafactory 

3 - Satlafactory 

2 - Marginally Setlefectory 

1 - Weak 



Because some objectives or domains 
provide a more difficult task., or 
becauae some Items were more difficult 
then others, the panel ratlnga ere not 
based on the score, but on the 
"widely held expectations" for students 
on those ltema at that grade* 





GRADE 4 


GRADE 7 


GRADE 10 


DOMAIN 
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1. Word a and Expressions 














Word Recognition 


77.6 


5 


70.2 


4 




— 


Context Cluee 


59.7 


3 


72.8 


5 


69.6 


4 


Multiple Meanings 


77.2 


5 


67.3 


3 


61.3 


2 


Structural Analysis 


63.2 


2 


— 


— 


— . 


— 


Figurative Language 










61.3 


3 


Total Domain 


— 


4 


— 


4 


— 


3 


2. Literal Comprehension 


75.2 


4 


78.4 


4 


72.7 


4 


3. Inferential Comprehension 


70.9 


4 


72.8 


3 


70.0 


4 


4* Critical Comprehension 


N/A 




70.4 


3 


63.2 


3 


5. Locates/Uses Information 














Locates Information 


72.1 


4 


83.1 


5 


71.9 


3 


Uaea Standard Formats 


84.8 


5 










Interprets Pictures 


79.8 


4 










Dictlonarlea 






73.8 


3 






Interprets Maps 






76.3 


4 






Interprets Graphic Material 










80.3 


4 


Total Domalu 




4 




4 




4 



COMPARATIVE ANALYSIS OF STUDENT ACHIEVEMENT LEVELS 



The 1984 assessment aurveya and analyses facilitated comparisons across grades and between British Columbia and the 
United States. 



1. CROSS-GRADE PERFORMANCE 

The 1984 Reading Assessment was designed to provide 
performance comparisons across grades. There were 10 
common items between Grades 4 and 7, and 11 common 
items between Grades 7 and 10. Two Items were used at 
all three grade levels. 

Results of Croas-grade Items 

Number of Mean Percent Correct 

Common Items Grade 4 Grade 7 Grade 10 



10 
11 

Item 1 
Item 2 



66 

32 
51 



82 
69 
78 
77 



79 
92 
83 



Domain 1: 
(sample) 



Understands Words and Expressions; 



This domain covered word recognition, context 
clues, multiple meanings, figurative language, 
and, for comparison purposes, structural 
analysis. The following is one of the ltema 
used at all three grade levels. 



A shout went up from the crowd as they saw the 
d» lght green and yellow livery of the palace 
guard. 

The word livery most likely means. 

Percent of Students 



Grade 4 



Grade 7 



Grade 10 



*A. special uniform. 51 

B. cannons* 5 

C. horses. 3 

D. royal family. 14 
E« t don't know. 26 

* right answer 



77 
4 
3 
6 

10 



83 
3 
4 
2 
7 



2. B.C. /U.S. COMPARISON OF STUDENT ACHIEVEMENT 

Some items from the National Assessment of Educational 
Progress (NAEP) 1980 Reading Assessment were used In 
the B.C. surveys. 

Mean Percent Correct 
B.C. Students U.S. Students 

Grade 4 

(11 ltema) Mean Age 9.8 Mean Age 9.5 



Comprehension 72 
Locates/Uses Information 81 



59 
79 



Grade 7 
(3 items) 

Comprehens *on 75 



Grade 10 

(3 items) Mean Age 15.8 

Locates/Uses Information 74 



Mean Age 12.8 Mean Age 13.5 
72 

Mean Age 17.5 
78 



B.C. students enjoy a slight advantage over their Amer- 
ican counterparts. 



Domain 5: Locates and Uses Information 

This domain dealt with locating and using infor- 
mation which sppeara in non-literary formats. At 
Grade 4, items included a glosssry, a menu, a news- 
paper index, a table of contents and a library 
card and pictures related to Social Studies. 
At Grade 7, material included a table of 
contents, dictionary, and maps. At Grade 10, a 
table of contents, graphs, and charts were used 
to teat thla domain. Due to the diversity 
of formats used, a sample*Has rfot. feteen included. 
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The coaparieon of student schleveasnt from one assessment to snother Is alwsys of interest, in the comprehension 
dooains, the bssls for comparison is extremely weak due to variations on item difficulty and grade level. 

It Is Important to keep In mind thst domain definitions! although similar, are not Identical across assessments* 

The final domain, locates snd uses Information, Is not Included because of the divergence In stimulus materials. 

However, It Is possible to compare the ratings of Interpretation Panels on the other domains at all three grades 
levels. 



GRADE 4 

In the 1984 Reading Assessment the Interpretation Panel 
Judged overall Grade 4 results to be Very Satisfactory , 
indicating a strong primary reading program. The 
higher ratings achieved were based on Improved perfor- 
mance. Panelists suggested that further improvement 
could be attained through emphasis on higher levels of 
comprehension, through Increased diversity of materials 
and through Increased Integration of reading with other 
language arts and content areas. 
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GRADE 7 

The Grade 7 Interpretation Panel Judged that the 
results indicated a relatively successful basic reading 
program* Where common items were used, 1984 Grade 7 
performance levels were similar to 1980 Grade 8 levels. 
There is some indication that the 1984 grade 7 panel 
expected higher performance levels than had the grade 8 
panel in 1980. 



•RADE 10 

Comparison of 1984 Grade 10 Interpretation Panel 
ratings to those Grade 12 In 1977 and 1980 are gen- 
erally not Informative. Ratings show greater satis- 
faction with current grade 10 performance than was 
indicated for the 1980 Grade 12 performance. 

I 
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RATING 


USES WORDS 
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CRITICAL 
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* 1976/77 and 1980 ratings were based on grades 4, 8 and 12; 1984 ratings on grades 4, 7, and 10. 
** D - Strong; 4 - Very Satisfactory; 3 - Satisfactory; 2 ■ Marginally Satisfactory; 1 « Weak. 



Domain 3: Inferential Comprehension: (sample) 

Tills domain required students to make general- 
izations, infer relationships or main ideas, or to 
draw conclusions. 



After reading an essay by Paul St. Pierre, Grade 10 
students were asked: 

Why do some people believe that it is cruel to 
allow wild horse bands to develop? 



20 A- Wild horses breed down domestic stock. 

9 B. Wild horses are often hunted and shot. 

7 C. Wild horses may be trapped and butchered 
for fox feed. 
hi) *D. Wild horses will eventually starve. 

3 S. I don't know. 
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Domain 4: Critical Comprehension: (sample) 

Requires stuuents to recognize the authors purpose, 
to evaluate conclusions, and to distinguish between 
fact and opinion* 



After reading an historical account of child labor, 
Grade 7 students were asked: 
Which one of the following statements is an 
opinion about child labor? 



10 A. Children worked in hot, sweaty places. 

8 B. Children were often beaten. 

9 C. Children worked six days a week. 

70 *D. Child labor should be against the l-w. 

3 E. I don't know. 



* right answer 
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Upom reviewing the student performance on the 
opea-eaded and fixed response ferae, tha Goat tact Tta 
recommended that i 

• Teachers at all grade levela focus attention on 
Inferential and critical reading skills and that 
students be required both to make inference!/ Judge- 
aents and to substantiate them; and 

• Teachers systematically instruct atudents In appro- 
priate skills and strategies for dealing vlth both 
open-ended and fixed response questions* 

To aalntaln B.C. students, vary positive attitudes to 
reeding, the Contract Tsaa raco— ended thati 

• Local school districts, vlth the assistance of the 
Ministry of Education, ensure that a range of recre- 
ational reading material reflecting student inter- 
ests and ability, as well as the range of content 
areas, is available to every B.C. student; 

Further, that teachers of all subject areas, working 
with librarians or other resource people, systemati- 
cally draw student attention to publications— parti- 
cularly recent releases — which fall within that 
domain content; 

. Secondary school teachers, librarians, and admini- 
strators examine patterns of library use, and 
develop strategies to enhance library use among 
secondary 9chool students, many of whom were avid 
library users in elementary school; 

English/ Language Arts teachers maintain an awareness 
of current popular fiction, non-fiction, and period- 
icals in order to encourage and to facilitate class- 
room discussion about student recreational reading; 

• Local districts and schools examine intermediate and 
Junior secondary language arts courses to ensure 
that a variety of literary genres — including 
poetry — are presented, and read, in every class- 
room. 

After coaparlng the background data with tha oat coma 
variables, the Contract Team recommended theti 

• Teachers of all subject areas direct special efforts 
toward fostering positive attitudes and increased 
reading among boys in the intermediate and secondary 
grades. The diversity of reading interests among 
these students must be recognized; the traditional 
emphasis on the novel as the basic recreational 
reading genre may be inappropriate for many of these 
students who display strong interest in nonfiction 
and periodicals; 

Teacher training institutions ensure that pre- 
servlce methodology courses in all subjecc areas 
include specific instruction related to the recog- 
nition of reading problems, the selection of appro- 
priate materials, the development of subject-speci- 
fic reading skills, and the establishment/extension 
of supplemental reading materials; and 

Local districts direct continued attention and 
resources toward those students who must overcome 
1 mguige, *oc lo-cul tural or other special problems 
In order to develop reading competence. 

The 1984 Reading Aaaeaaaent is the flrat to provide 
school -level results. In view of the relevance to 
clsaarooa teachers, the Contract Teaa reco^aendad 

that: 

. School-level result* be used to identify exemplary 
read'ng programs, and that these be analyzed to 
Identify salient characteristics; 

. Si-hunt -level results be interpreted with reference 
t.. Witnwn characteristics of the relevant student 
O i'opt%l.jUon, and; the xelatVpnaMpa, between background 
JC *:haiacMH4^ B V V nd f itijdjnt. J>«t^>nes which have 
IBB been described in this report*; 



• The Ministry provide guidelines for future district 
or school use of the 1984 achleveasnt surveys ; and 

• Teachers and district personnel be systematically 
directed to those sections of the General Report 
which have relevance to their current raeponal* 
bilitiee. Districts aay be well-advised to repro- 
duce and circulate selected sections of the General 
Report to appropriate groups of classroom teachers • 

In tha process of completing this assessment, coaearaa 
have arisen regarding tha organisation of current cur- 
ricula to recognise tha pervasive aatara of reading* 
In light of those concerns, it was recoaaended that! 

• The Ministry of Education review the elementary 
language arts guide , to ensure that the concept of 
integration is operationally defined; the nature of 
student reading experiences is aade explicit; and 
the language arts objectives specified in Social 
Studies and Science curriculum guides are 
addressed; 

• The Ministry review and revise the scope-and- 
sequence chart for Secondary English in light of 
expectations faced by current students across all 
curriculum areas* Further, if students are to he 
systematically streamed into alternate English 
courses in Senior Secondary grades, entry level 
competencies required for various Grade 11 courses 
be made explicit; and 

• The Ministry provide resources designed to assist 
Language Arts and content area teachers in diag- 
nosing student needs and assessing student compe- 
tence in reading both literary and content areas 
materials • 

Regarding the assessment of student competence in 
reading, it is racomaandad that: 

« Reading assessments continue to focus on outcomes— 
as opposed to enabling skills — through the selection 
of realistic materials and tasks; 

• The Ministry re-iterate the assessment program 
schedule and purposes to facilitate planning and 
effective use of results by districts and schools; 

• The use of "I don* t know** as an option on reading 
surveys be .econsidered in view of the absence of 
"content** and the desirability of using deductive 
strategies to obtain meaning; 

• Response formats be vjv led according to the objec- 
tives of primary interest; where these include 
organization synthesis, or evaluation of materials, 
some provision for extended or open-ended responses 
is required; and 

• Future reading assessments maintain a strong focus 
on student reading attitude? and behaviors to enable 
examination of program effects. This information is 
of particular value to schools which are making 
sustained efforts to promote positive attitudes and 
enhance recreational reading. 

To those responsible for dssigning, managing, and 
executing applied research involving language 
ekills it la recommended that! 

• Research attention be directed to the development of 
student beliefs and perceptions about the value of 
reading; 

. Research attention be further directed to inter- 
actions between stimulus material, and student com- 
prehension; and 

. Data from this assessment be further analyzed to 
simultaneously examine the effects of student , 
school, and district characteristics on student 
achievement and affective outcomes* 
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Among ichool related material!, students at All grtdei 
displayed the moat positive Attitudes towerd those 
essocleted with Engllsh/Unguege Arts; ths leest posi- 
tive toward content eree textbooks • The one exception 
occurred et Grede 7, where etudente reted poetry below 
ell other material! • An unexpectedly high number of 
etudente reported thet they do not reed poetry In 
echoolt 8% et Grede 4, 17X et Grede 7, end liX et 
Grede 10* 

Few etudente report not reeding novels, reedere/ehort 
e tor lee, or science texts In echoolt The uee of eoclel 
stud lee texte lncreesee dramatically with grede level* 

Results Indicate strong associations among achievement, 
ettltude, home environment end Involvement In leisure 
reeding • The etrength of theee eeeocletlone lncreeeed 
with grade level. Language background Is aeeocleted 

with achievement, but not with ettltude • 



The open-ended forme provide conflrmetlon of the 
findings thet etudente et ell grade levele demonstrate 
relet lvely high levele of llterel comprehenelon, end of 
skill In organising factual materiel • Levele of infer- 
entlel comprehenelon are generelly eetlefectory; how-* 
ever, meny students ere unable to subs tent let e their 
lnfsrencss. Levele of crltlcel comprehenelon ere of 
eome concern, pertlculerly et Grede 10 where few etu- 
dente demonetreted systemetlc etreteglee for evaluating 
me*;er lels • 

Grede 10 students who plen to attend university 
demonstrated relatively high levele of echlevement and 
positive attitudes. On the other hand, thoee who plen 
to enter the workforce directly obtained eubetentlelly 
lower echlevement scores, end demonetreted much leee 
positive ettltudes toward reading than did the other 
etudente* 
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Provincial Level 

Representatlvea of the Leernlng Assessment Brench will 
meet with other branches to Inform them of the data 
collected and of the recommendations directed at the 
Mlnxstry of Education. Information meetings with the 
Education Faculties of the three universities are also 
planned. 

The next assessment of Reading Is scheduled to take 
place In 1988. 



District Level 

Tne Learning Assessment Branch has provided each dle- 
trlct with reports showing district and provincial 
results at each grade level. Each district Is 
encouraged to dlacusu district performance In light of 
these findings and to make recommendations to the Board 
of School Trustees. 

School reports giving domain level results have been 
prepared for every school In the province that wee 
Involved In the assessment. Interpretation of the 
school level results Is to be done under the direction 
of the superintendent or hie designate* 



The assessment was conducted by a team under contract 
to the Learning Assessment Branch. Members of the 
Contract Team were: 

S. Jeroskl (Chairman), Horizon Research 

and Evaluation Affiliates 
G. Labercane, University of Calgary 

C. Tolsma, Vancouver Community College 
K. McKlnnon, Chllllwack School District 
M. Qulgley, Richmond School District 

Members of the Advisory Committee were: 

A* Tout ant (Chairman), Learning Assessment Branch 

K. Knowles (Chairman), Learning Assessment Branch 

G. Aeblg, Carlboo-Chllcotln School Dlstr ct 

D. Bateson, Learning Assessment Branch 

J . Cleugh, Curriculum evelopment Branch 

A. Cresswell, Simon Fraser University 

A. Hagen, Trustee, New Westminster School District 

F. Klrkhan, Coqultlam School District 

E. Kwasnickl, Queen Charlotte School District 
M. Lesnik, Arrow Lakes School District 

W. MacGlnltle, University of Victoria 

J. Matheson, Learning Assessment Branch 

V. McClelland, Richmond School District 

C. Rutherford, Campbell River School District 



The Summary Report of the 1984 Reading Assessment 
preeents highlights of the survey, summary tables of 
Important results , and conclusions and recommendations 
made by the Contract Team. This report was distributed 
to school district offices In sufficient quantities for 
one copy per school, to university and colleges, and 
to other education Institutions. 

The General Report Includes all results of test Items, 
In depth discussion of Issues, and the conclusions and 
recommendations of the Contract Team. The distribution 
of this report Is limited because of the technical 
nature of Its content. 

Additional copies of these reports, in limited numbers, 
are available from: 

Learning Assessment Branch 
Ministry of Education 
Parliament Buildings 
Victoria, B.C. 
V8V 2M4 

(604)387-4611 
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